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Overview 


•  Background 

°  Centers  for  Innovative  Naval  Technology  (CINT) 
°  UV  Sentry  Concept 
°  Proposed  Scenario 

•  Summer  Objectives 

•  Discussion  of  Results 
°  Developed  CONOPS 
°  Platform 

°  Autonomy 
°  Communications 
°  Human-Machine  Interfacing 
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Background:  Centers  for  Innovative  Naval  Technology 

•  Underlying  Structure: 

°  Single  Overall  Project 

°  Student  Interns  at  Multiple  Centers 

•  NREIP 

•  SMART 

°  Mentors  and  Advisors  at  Each  Center 

•  Objectives: 

°  Concept  Development  and  Exploration 
°  Cross  Lab  Collaboration 
°  Students  Exposure  to  Multidisciplinary  Team 
Projects 
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Background:  UV  Sentry 


•  Multiple  Unmanned  Vehicle  System 
n  Autonomous  Collaboration 

°  Heterogeneous  Mix  of  Vehicles 

•  Force  Protection  Role 

a  Expanded  Situational  Awareness 
°  Reduced  Response  Times 
°  Flexible  Mission  Profiles 
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Background:  UV  Sentry 


•  Originally  Envisioned  for  Sea  Base  Protection 


*Sea  Base 

*  18  nmi  radius 

*MIW 
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*ASW  &  SUW 
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Background:  UV  Sentry 


Several  Identified  Missions: 


•  Maritime  Facility  Protection 

°  Persistent,  long  endurance,  asset-limited  surveillance 
and  tracking 

•  Counter  Drug  Operations: 

°  Persistent,  long  endurance,  wide-area  surveillance 
and  tracking 

•  Maritime  Security/  Anti-Piracy 

°  Persistent,  long  endurance,  wide-area  surveillance 
and  warning 

•  Maritime  Domain  Awareness 

°  Persistent  ISR,  automated  data  fusion,  autonomous 
mission  planning  and  task  allocation 
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Background:  Anti -Pi  racy  Scenario 


219  attempted  pirate 
attacks  off  the  coast  of 
Somalia  in  2010 

Greater  than  $8oM  was 
paid  out  in  ransom 

Costs  maritime  industry 
$i-i6B 

(Peter  Chald,  Rand  Corp 
2009) 

Number  of  attacks  and 
dollars  paid  out  in 
ransom  increasing  each 
year 
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Background:  Anti -Pi  racy  Scenario 

Area  of  Protection 


Vuqdttho 


Extension  of  IRTC 

(Internationally  Recommended  Transit  Corridor) 


Maldives 

©2011  Google  -  Imagery  ©2011  TerraMetrics,  Map  data  ©2011  Europa  Technologies,  Google,  LeadDog  Consulting,  Mapabc,  TraJ 


Detail  of  protection  area 
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Background:  Anti -Pi  racy  Scenario 


•  Typical  Convoy  Based  Force  Protection  Schemes 
Not  Viable: 

n  33,000  ships  pass  through  per  year 
a  3  days  to  transit  area  of  protection 
n  300  ships  in  area  of  protection  at  one  time 
°  15  minute  response  times 

•  Major  Challenges 

°  Reduction  in  Response  Time 
°  Increased  Situational  Awareness 
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Summer  Objectives 


•  CINT: 

°  Provide  Stimulating,  Challenging,  and 
Educational  Problems  for  the  Summer  Students 
°  Foster  Interdisciplinary,  Cross-Warfare  Center 
Teams 

°  Establish  a  model  from  which  future  CINT  efforts 
could  draw. 

•  UV  Sentry 

n  Evaluate  Technical  Feasibility  of  Concept 
°  Identify  Technologies  of  Interest  for  Future  Study 
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Summer  Objectives:  Topic  Focuses 


•  Platform  Objectives: 

°  USV  design  to  meet  needs  of  scenario 

n  Explore  small  craft  design  without  need  for  onboard  human  operator 

•  Autonomy  Objectives: 

°  Identify  enabling  technology  and  methods  for  the  autonomous, 

decentralized  operation  of  multiple,  heterogeneous  unmanned  vehicles 

°  Focus  Areas: 

•  Real-time  tasking 

•  Machine  learning 

•  Autonomous  target  identification  and  classification 

•  Communication  Objective: 

°  Identify  requirement  drivers  for  the  UV  Sentry  communication  system 

•  Human-Machine  Interaction  Objectives 

°  Identify  Human-Machine  Interface  (HMI)  requirement  drivers 
°  Explore  the  implications  related  to  increasing  the  level  of  autonomy  in 
system 
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Results:  System  CONOPs 


FOCUS:  UV  Sentry  Concept 
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■ 

Game-changing  capability: 


Counter  the  maritime  asymmetric  threat  with  a  highly 
autonomous  system  of  unmanned  systems 


General  CONOPs 

•  Leverage  Platform 

Capabilities 

°  UAVs  -  Comms  relays 
and  broad  area 
surveillance 

°  USVs  -  Local  recon 
and  threat  interdiction 

°  UUVs  -  Discrete 
surveillance 

•  Zonal  Coverage 

•  Human  in-the-loop 

Control  Systems 
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UxV  System  Operational  View 


Remote  Supervisory  Control 
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•  Deployed  &  serviced  by  Service  Ship 

•  Loiter  until  pirate  threat  detected 

°  Each  USV  guards  a  77x12  nm  area 
°  13  USVs  needed  for  complete  coverage 
n  5  days  between  servicing 

•  Intercept  pirate  threat  (sprint  up  to  39  nm) 
n  Provide  ISR 

°  Delay,  Deter  or  Monitor/Follow 


◄ - ► 

77  nm 


USV  patrol  area 


12  nm 


39  nm  < 
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Results:  USV  Requirements 


•  Endurance:  6  days  (1  day  buffer) 

•  Speed:  40  knots  sprint  speed 

°  Allows  for  60  minute  or  less  response  time 
anywhere  in  zone 

•  Sea  State  (S.S.) 

a  Operable  in  S.S.  4  (2.5m  waves) 
a  Survivable  in  S.S.  7  (9m  waves) 

•  Loiter  in  up  to  1.5  knot  current 
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Hydrofoil  Supported  Catamaran 


Length  Overall 

11  m 

Beam 

4.7  m 

Draft 

0.8  m 

Displacement 

7.8  tonnes 

Speed  (S.S.  4) 

40  knots 

Duration 

6  days 

Installed  Power 

898  kW 

Characteristics 


Isometric  View 
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Results:  Group  Autonomy 


•  Game  Theory  (GT)  is  used  to 

determine  the  Group  Mode. 

n  Every  possible  action  is  given 
an  objective  function. 

°  Each  function  is  evaluated 
given  the  current  state  of  the 
environment. 

°  The  highest  function  value  is 
chosen  for  the  next  action. 


•  Market-Based  Tasking  (MBT) 

is  used  to  determine 

Individual  Tasks. 

n  MBT  uses  an  auctioning 
system  to  optimally 
redistribute  Tasks. 

°  Periodically  each  UV  auctions 
it  current  task. 

n  Participants  place  bids  on  the 
task  using  a  personal  cost- 
benefit  function. 

°  The  highest  bid  wins  the 
auction  and  is  assigned  the 
task. 
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Results:  Machine  Learning 


Big  Picture:  Benefits  of  Machine  Learning: 

•  Machine  learning  leverages  cheap  computational 
power  rather  than  expensive  man-power 

•  Learned  policies  can  compete  with  or  exceed  the 
performance  of  human- designed  policies 

•  Learning  can  provide  robustness  and  features 
such  as  scalability 

•  Learning  algorithms  are  domain  independent 
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Scripted  Search  Pattern 
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Naval  Technology 


2/10/2012 


Learning 
Search  Patterns 

Patrol  Training  Domain 

•  7'USV's 

n  3  nm  sensors 

°  25  knot  speed 

•  Potential  'pirate'  threats 

°  Randomly  appear  along  edges 
of  operational  area 

°  Traverse  a  straight  line  to  a 
random  point  on  opposite  edge 

°  10  knot  speed 

•  Learned  policy  'USV's  must 
come  within  half  sensor  range  to 
remove  threat 

°  Hand  designed  parallel  search 
is  relaxed  to  full  sensor  range 


Learn  Search  Behavior 
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Results:  Machine  Learning 


Original  Task  Vertical  Only  Increased  Agents 


■  Scripted 
□  Learned 


•  Learned  policy 
competitive  with  scripted 
policy  that  incorporates 
domain  knowledge 

•  Learned  policy  more 
robust  to  changes  in  the 
domain 


Task  Variant 


Learned  scales 
performance  with 
number  of  agents 
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Results:  Object  Recognition 


Rapid  Image  Exploitation 
Resource  (RAPIER) 

•  What  is  RAPIER? 

°  Framework  for  processing 
satellite  imagery 

n  Automatically  detect  targets 
and  analyze  imagery 

•  Allows  one  to  create  new 
algorithms  to  plug  into  RAPIER 
(airplanes,  vehicles,  roads,  etc.) 
-  currently  used  for  ship 
detection 

•  Handles  variety  of  data  sources  : 
SAR,  EO,  Multispectral,  IR,  etc 

•  Large  Computational  Loads 
°  Increased  Preprocessing 

°  High  Bandwidth 


Advanced  Algorithms  Detect  Ships 
behind  Clouds  and  in  Rough  Seas 
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Results:  Communication  Systems 


•  Challenges: 

°  Variable  Bandwidth  Loading  with  High  Peak 
Loading 

a  Large  Distributed  Network  without  Set 
Architecture 

•  Proposed  Solution: 

a  Ad  Hoc  Network  Structure 

°  Communication  Pathways  reconfigure  based  upon 
bandwidth  demands 
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Results:  Communication  Systems 


10000  ft 


UAV  at  higher 
altitude  acting  as 
gateway  for  US V  to 


Normal  USV  to  USV 
Comms  Scenario 


USV  comms 


i 

UAV's  at  lower  altitudes 

M 

are  not  used  as 
gateways 

Low  Bandwidth  Network  Concept  High  Bandwidth  Network  Concept 
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Results:  Human  Factors 


•  Automation  Level  Concerns 

n  Too  much  automation  under  utilizes  users,  reducing  their 
situation  awareness  and  overall  system  performance 

°  Too  little  automation  overloads  users,  reducing  their  situation 
awareness  and  overall  system  performance 

n  Balance 

•  Human  -  Machine  Interface  Design  Concerns 

n  Focus  on  the  users  and  their  tasks,  not  the  technology 
°  Consider  function  first,  presentation  later 
°  Conform  to  the  users’  view  of  the  task 
°  Do  not  complicate  the  users’  task 
n  Promote  learning 
°  Deliver  information,  not  just  data 
n  Design  for  responsiveness 
°  Try  it  out  on  users,  then  fix  it 
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Results:  Human  -  Machine  Interface 


^  luav  1 


Currant 


Currant 

Wisiitih 


Atiudd 


Control 


ITeam  Leaded 


HVA  1  has  been  warned 
of  threat  and  will  travel 
NE  at  a  speed  of  1 0 
knots  to  maximize 
distance  from  pirates 


LUAV  1  confirmed 
threat.  The  target 
has  ignored  radio 


warnings  and  is 


heading  for  HVA  1 


Message 


.Action 


USV1 


8574 


ETA 

ETA  before 
Threat 

Capabilities 

10  mins 

5  mins 

B,AD,  PG 

Udu.iiijd 

1  liHd 

1 1  Hi  1  h 

Idanlifedl  thra dl  nllAVZand  1 

015 

000 

ETA 

ETA  before 
Threat 

Capabilities 

5  mins 

10  mins 

SG.AD 

Take  Control  1  ITeam  Leader! 

HVA  1  leaving  USV  Zone  3  to  USV  Zone  7 

USV  3 

USV  2 

None 

730 

Polertlial  threat  identified  in  IJUV  Zone  4 

UUV  4 

LUAV  0 

LUAV  6  moving  to  shadow  potential  fflreat 

9®T2015 

700 

All  clear  i  n  IJAV  Zone  4 

LUAV  4 

System 

None 

SMBT20 1 5 

645 

USV  1  bat  ttimmsdue  10  high  seas 

USV  1 

System 

USV  1  moung  to  calmer  waters 

mi, 2015 

630 

2Z 


SPAWAR 

▼ 

Systems  Center 
PACIFIC 


Centers  for  Innovative 
Naval  Technology 


2/10/2012 


Results:  Summary 


•  A  large  number  of  the  necessary  pieces  of  UV 
Sentry  are  being  actively  developed  for  use  in 
other  programs 

°  Machine  Learning 
a  Object  Detection 
°  Communication  Networks 
°  Single  Vehicle  Autonomy 
□  HMI 

•  The  viability  of  UV  Sentry  is  dependent  upon  the 
integration  of  all  of  the  technical  components 
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